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§0. Introduction. 

The problem of representing an integer as a sum of squares of integers has had a 

long history. One of the first after antiquity was A. Girard who in 1632 conjectured 

that an odd prime p can be represented as a sum of two squares iff p = 1 mod 4, and 

P. Fermat in 1641 gave an "irrefutable proof" of this conjecture. The subsequent work on 

this problem culminated in papers by A.M. Legendre (1798) and C.F. Gauss (1801) who 

found explicit formulas for the number of representations of an integer as a sum of two 

squares. C.G. Bachet in 1621 conjectured that any positive integer can be represented as 
"xl" . 

a sum of four squares of integers, and it took efforts of many mathematicians for about 
150 years before J.-L. Lagrange gave a proof of this conjecture in 1770. 

A radically new approach to the problem, based on the theory of elliptic functions, 
was found by C.G.J. Jacobi in his famous Fundamenta nova [J] published in 1829. In order 
to state his results, introduce the following power series in q: 

S3' 

Then, clearly, the coefficient of q k in the power series expansion of I2(q) d is the number 
of representations of k as a sum of d squares of integers (taking into account the order of 
summands). Jacobi discovered the following remarkable identities, which gave a solution 
to the problem for d = 2, 4, 6 and 8: 
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(o.i) a( q ) 2 = i + 4 y, (-i)y (2fc-i) , 

j,k=l 
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(0.2) a(q) 4 = 1 + 8 J2 kq J \ 

j,k = l 

OO 

(0.3) U{qf = l-A J2 (-l)^ J - 1){k+1) (f-k 2 )q^\ 



3,k = l 

j~>h,j — fcodd 



(0.4) U(qf = 1 + 16 ^ (-l)k' +1 ) fc fcV fc . 

j,k=l 

Further development has been based, starting with the works of Jacobi and Legendre, 
on the theory of modular forms. Explicit formulas for odd d < 7 have been found by 
Legendre, Eisenstein, Smith, Hardy and Ramanujan (the case of odd d is much harder 
than that of even d). In the 1860s J. Liouville obtained a series of beautiful formulas for 
d = 10 and 12. In 1917 L.J. Mordell showed how in principle the problem can be solved for 
even d using the Fricke-Klein theory, but the difficulties increase rapidly with d. One can 
find a detailed (but quite disordered) account on sums of squares in Volume II of Dickson's 
"History of the Theory of Numbers" (Chapters VI-IX). 

The related problem of representing a positive integer by sums of triangular numbers 
(i.e., numbers of the form |j(j + 1), j — 0, 1, . . .) has also been quite popular, and a number 
of deep results was obtained by Gauss, Legendre and others (see Chapter 1 of Vol. 2 of 
Dickson's "History"). Here the problem, clearly, is to find a power series expansion of 
powers of the series 
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The main objective of the present paper is to demonstrate that representation theory 
of affine superalgebras is a natural framework for the study of the problem of sums of 
squares and sums of triangular numbers. However, in order to state our main result we 
need only the following notions. Let V be a finite-dimensional vector space over M. with 
a non-degenerate symmetric bilinear form (.|.). Let A be a finite set of vectors in V not 
containing 0, called the set of roots, and let A = A U Ai be represented as a disjoint union 
of two subsets, called the sets of even and odd roots. A choice of a linear function / on 
V which does not vanish on A defines a subset of positive roots A + = {a G A\f(a) > 0}; 
we let A e+ = A e fl A + , e = 0,1. Given a G V we define the exponential function e a 



by e a (v) = e( a \ v \ We call the Weyl denominator associated to the above root data the 
function 

R = 




Let q be an indeterminate; we call the affine denominator the infinite product 




where £ is the dimension of the M-span of A. Our main objective is to find expansions for R 
and R. Of course, in the case when A = Aq is the set of roots of a simple finite-dimensional 
Lie algebra, an expansion for R (resp. R) is given by the well-known Weyl denominator 
identity (resp. Macdonald identity [Mac]), see e.g., [K9]. Our main Theorems 2.1 and 4.1 
extend these results to the case when A is a set of roots of a finite- dimensional simple Lie 
superalgebra g with a non-degenerate Killing form. 

The connection to sums of squares is obvious. Indeed 
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(0) = Yl (1 - q n Y + \ A "\ / (1 + q n )\^ 



n-l 



and if it happens that 

(0.5) *+|A | = |Ai|=:d, 

then we get an expansion of \Z\(q) d , in view of Gauss' identity 

AJ - 1 + q n 

n—l 

Evaluating at points other than 0, one gets expansions for triangular numbers (and, more 
generally, m-gonal numbers). 

To be more specific, let us give an example of a root system of type A(m — 1, n — 1), 
where m > n > 1. Let V be the (to + n) -dimensional vector space over R with basis 
ei, . . . , e m , Si, . . . , S n and the symmetric bilinear form given by (ei\ei) = —(Sj\Sj) = 1 for all 
i and j and zero for any other pair. Let A = {e^ — Cj \ 1 < i, j < to, i ^ j} U {Si —Sj\l < i, 
j < n, i ^ j}, Ai = {ei - Sj,Sj - e;|l < i < to, 1 < j < n}, A = A U Ai. Let 



A_|_ = {ei — €j, Si — 5j\i < j} U {ei — Sj\i < j} U {Si — €j\i < j}. Condition (0.5) holds iff 
m = n + 1. In this case, i.e., A of type A(n, n — 1), the denominator identity is 
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^c . . — 1 V x w(i) / 



, , ; ,, x ■?' i<j ^ yj '^ i<j ^ *^' i<j ^ ■? 



Here Xi = e~ e \ yi = e~ Si , z and j take all possible values and e(w) is the sign of the 

permutation w G SVi+i- Furthermore, the affine denominator identity reads: 

(0.7) 



1-^1-^/1 + ^1 + ^ 

x jJ V VsJ \ VrJ V " x 3 



R-fifd-**)- 1 n ( 

fc=l \ l<i,j<n + l V 

\ 1 <r,s<TJ. 

n / \ 



Here M n is the sublattice of the lattice J+ Zq of vectors with zero sum of coordinates 
(= the root lattice of type A n ) and x m := x™ x . . -x™Z\ X ■ Dividing both sides of (0.7) by 
R and taking limit as Xi, yi — ► 1, we obtain an expansion of \Z\(q) 2n ^ n+1 > . One of the 
ways to actually compute this limit is explained in the proof of Theorem 4.2, but probably 
there is a different way giving a better formula. Of course, for n = 1 we thus recover 
Jacobi's formula (0.2). Another specialization of (0.7) gives the following expansion (see 
Example 4.3b): 






(0.8) U{-q) 2n = 2 n J2 E(- 1 ) |s| ^ Ii * i ^ =l(m?+m^ " m^5^) ^I( 1 + , 

m€M„ s6§ j=l 

where § is the set of all subsets of the set {e^ — €j\i < j} (= set of positive roots of type 
A n ), and s (resp. \s\) denote the sum (resp. number) elements from s G §. Formula (0.8) 
for n = 1 is an equivalent form of (0.1). 

Even the simplest case of (0.6), when n — 1, is a truly remarkable identity. Letting 
u = —Xi/yi, v = — £2/2/1, it takes the following beautiful symmetric form: 
(0.9) 

(1 - q n ) 2 (l - uvq 71 ' 1 )^ - u^v^q 71 ) 
n= l (1 - uq^)(l - «" V)(l - vq^)(l - v-W , w=0 min= _ ly 

After establishing this identity, we realized that it has been rediscovered many times in the 
past. It is implicitly contained in [KL] as it follows immediately by comparing characters 
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in the super boson-fermion correspondence (which gives a combinatorial proof of (0.9)), 
and in [M] where it is used to rewrite the characters of N = 2 superconformal algebras in 
a multiplicative form. As has been pointed out in [F] and [H], (0.9) is a special case of the 
Ramanujan summation formula for the bilateral basic hypergeometric function 1^1. 

Condition (0.5) holds iff q is of type A{n, n— 1), B(n, n) or D(n+1, n+1) (n = 1,2,...), 
which gives an expansion for 0(q) N for N = 2n(n+l), 2n(2n+l) and 4(n+l) 2 respectively 
(given by Theorem 4.2; see also Examples 5.3 and 5.4). The first members of the first and 
the second series are Jacobi's formulas (0.2) and (0.3). The second member of the first 
series gives an expansion for D((/) 12 , however we do not know how to derive from this 
expansion the famous result of J. Liouville (1860) that the number of representations of 
2k, where k is odd, as a sum of 12 squares equals 264 V,^' 5 . Finally note that Jacobi's 
formula (0.4) is obtained by evaluating at the (conjectured) denominator identity for the 
case g = gl(2, 2), which is a Lie superalgebra with a zero Killing form (see Conjecture 7.1). 
Another very interesting case which is not covered by Theorem 4.1 is q = Q(m) (see 
Conjecture 7.2). A specialization of the corresponding affine denominators gives very 
beautiful power series expansions of A(q) 4s and A(g) 4s( - s+1 - ) (see Section 7). For s = 1 
we thus recover Legendre's formulas for sums of 4 and 8 triangular numbers (whereas 
formulas for 2, 4 and 6 triangular numbers are obtained by certain specializations of the 
affine denominator identities for A(1,0), A(1,0) and .8(1,1) respectively, see Section 5). 
For s > 2 we obtain formulas which are probably new. For example, we find that the 
number of representations of n as a sum of 16 triangular numbers equals 

^ £ «*«.' -*")'■ 

a,b ,r,s GNodd 

a>b 
ar+bs = 2n-\-4 

In Section 1 we recall the necessary material on a simple finite-dimensional Lie su- 
peralgebra g [K2] . The new material here concerns the dual Coxeter number h v (which is 
the eigenvalue of the Casimir operator associated to the suitably normalized Killing form). 
As in the Lie algebra case, h v plays an important role in the theory of affine superalge- 
bras. In Section 2 we introduce the important notion of the defect of q (which is in 
the Lie algebra case) and of a maximal isotropic set of roots. This allows us to state the 
denominator identity (Theorem 2.1) for the root system of g. We give a proof which works 



in the case of def g < 1 (which takes care of all exceptional Lie superalgebras) . A proof 
in the general case involves more calculations and will be published elsewhere. At any 
rate, the proof is based on the analysis of irreducible subquotients of the Verma module 
M(0) over g with highest weight 0. Since the denominator identity may be viewed as the 
character of the 1-dimensional g-module, it is only natural to go on and try to compute in 
Section 3 the character of an arbitrary finite-dimensional irreducible g-module V. There 
has been a number of papers concerned with this problem [K3, K4, BL, TM1, TM2, VJ1, 
VJ2, JHKT1, JHKT2, P, PS1, PS2, S, Se, . . .]. Our basic new ingredient is the notion of a 
A-maximal isotropic subset, which allows us to define atypicality of V which is independent 
of the choice of the set of positive roots, and of a tame 0-module V. Our first basic result 
is Theorem 3.1 which states that V is tame (and hence gives a formula for chl/) in the 
case when for some choice of the set of positive roots there exists a A + p-maximal isotropic 
subset consisting of simple roots. (Note that Theorem 2.1 is a special case of Theorem 3.1 
since def g = atpO.) This theorem covers most of the known formulas for chl/ (proved in 
[K3, K4, BL, VJ1, VJ2, JHKT2, . . .]), but unfortunately there exist V that are not tame. 
We describe all cases of non-tame V of atypicality < 1; this gives, in particular, character 
formulas for all V over exceptional Lie superalgebras (Example 3.3). We also give a proof 
of a dimension formula (Theorem 3.2), which is based on a nice regularization procedure, 
and of a superdimension formula (Theorem 3.3), which is based on an interesting property 
of the root system of g (Lemma 2. 2d) and on Theorem 2.1. 

In the second part of the paper (Sections 4-8) we turn to the associated to g affine 
superalgebra g. The main result is Theorem 4.1 which gives the affine denominator identity 
in the case when the Killing form is nondegenerate (equivalently, h y ^ 0). The proof is 
again based on the analysis of irreducible subquotients of the Verma module over g with 
zero highest weight. (Of course, this is the basic idea of the proof of Macdonald identities 
given in [Kl].) Examples 4.4 and 4.5 give a more convenient form for specializations of the 
affine denominator identity. Theorems 4.2 and 4.3 and Example 4.3b give explicit formulas 
for two specializations of this identity. These formulas are applied in Section 5 to derive 
expressions for the number of representations of an integer as sums of squares and sums of 
triangular numbers. In Section 6 we use the simplest affine denominator identity to study 
transformation properties of certain "degenerate" theta functions and modular forms and 
apply this to prove transformation properties of the N = 2 superconformal algebras, cf. 
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[RY]. (These results may be extended to the general case by the same method.) In Section 7 
we discuss the affine denominator identity for g — gl(2, 2), the simplest case when /i v = 0. 
Another extremely interesting case is g = Q(m). We conjecture the corresponding affine 
denominator identity and derive formulas for the number of representations as sums of 
triangular numbers in terms of dimensions of irreducible representations of s/ m +i. Finally, 
in Section 8 we introduce the notion of an integrable g-module, based on our experience 
with the 1-dimensional module. Theorem 8.1 gives a classification of irreducible integrable 
highest weight g- modules L(A). 

(As in the Lie algebra case, the level of such a module is a non-zero integer, but 
there may be infinitely many such modules of positive level.) It is an extremely interesting 
problem to calculate the characters of integrable L(A). A partial answer is given for 
A(1,0) A (Example 8.1). Of course, in the case when def g = the answer is well known 
for both g and g [K5]. 
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§1. Dual Coxeter number. 

Let q = go + 0i be a finite-dimensional simple Lie superalgebra over C with a non- 
degenerate even invariant bilinear form B. Recall that "even" (resp. "invariant") means 
that _B(0o,0i) = (resp. B([a,b],cj = B{a, [b,c]},a,b,c G 0) and that all such forms are 
proportional. Denote by h B the eigenvalue of the Casimir operator Vt B associated to B 
[K2, p. 85] in the adjoint representation. 

Proposition 1.1. h B ^0 if and only if the Killing form is non-degenerate. 

Choose a Cartan subalgebra f) of 0o, let A G h* be the set of roots, A and Ai the 
subsets of even and odd roots and let W C GL(l)*) be the Weyl group (= the group 
generated by reflections r a with respect to even roots a). Let = f) © ( ® Q ) be the 

VaeA / 

root space decomposition. 

Recall that an odd root a is isotropic (i.e. B(a, a) = 0) iff 2a is not a root. We let 

A = {a E A J \ol i A}, Ai = {a G Ai J (a\a) = 0}. 

Then Ai \ Ai = -|(Ao\A ) and A is a root system. 

Choose a set of positive roots A + in A, let A e+ = A e fl A + (e = or 1) and let 
n + = ® a - Let n = {ai, ...,«;} C A_|_ be the set of simple roots and let 9 G A + 

a€A + 

be the highest root. Let p e be the half of the sum of the roots from A e+ and and let 
p = po — p\. Then, S(p, oti) = ^B(ai, o^), i = 1, . . . , /. Furthermore one has 

h w B = B(p,p) + iB(0,0). (1.1) 

The following generalization of Freudenthal-de Vries "strange formula" holds: 

B(p, p) = ^f (dim 00 - dim 01 ). (1.2) 

Assuming that h B 7^ 0, let 

Aj = {a G A J h B B(a,a) > 0} 



(this is independent of the choice of B) , and let W^ denote the subgroup of W generated 
by reflection r a with respect to all a G A Q . Denote by (.|.) the even invariant bilinear form 
on g normalized by the condition 

(a\a) — 2 for the longest root a G Aq. (1-3) 

The corresponding to this form number /i v = hY, \ is called the dual Coxeter number of 
the Lie superalgebra q. We let /i v = if h y B = 0. We give below the number h v in all 
cases (excluding Lie algebra cases): 

A(m,n) : /i v = \m — n\; C{n) : /i v = n — 1; 

B(m, n) : /i v = 2(m — n) — 1 if m > n, =n — m + |ifm<n; 

Dim, n) : h v = 2(m — n — 1) if m > n + 1, = n — m + 1 ii m < n + 1; 

D(2,l;a) : /i v = 0; F(4) : ft v = 3; G(3) : h y = 2. 

Remarks 1.1. (a) Let k( . , . ) denote the Killing form, which we assume to be non- 
degenerate. Then A = {a G Ao | «(a, a) > 0} is the root system of one of the simple 
components of 0o an d h v = n(a, a) -1 for the longest a G A . 

(b) h v = if and only if q is of type A(n,n), D(n + 1, n) or -D(2, 1; a) [ ]. In these 
cases we define A as follows. The root system Ao is a union of two orthogonal to each 
other root subsystem; namely one has respectively: 

A = 4U4, D n+1 UC n , D 2 Ud. 

Then we let A to be the first subset and W^ to be the subgroup of W generated by the 
r a with a G A . We normalize (.|.) by (1.3) as before. 

(c) There are many VF-inequivalent choices of A+. However, there is a unique (up 
to an automorphism of the root lattice) choice of A+ such that IT contains a unique odd 
root; we call this A + standard. 
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In order to prove the above statements, recall that [K2, p. 85] the eigenvalue of the 
Casimir operator Qb in a representation with highest weight A is equal to 5(A, A + 2p) 
and that when the Killing form k is non-degenerate one has: 

k(0,0 + 2 P ) = 1 (1.4) 

provided that dim go 7^ dimjji. Since 

dimg = dimgi iff g ~ A(n + 1, n), B{n, n) or D{n, n) (1.5) 

and since (1.4) is a polynomial identity which holds for all other values of (m,n) (except 
when k = 0) we obtain that (1.4) holds in all cases when k is non-degenerate. This proves 
Proposition 1.1 and formula (1.1). 

From formula (2.1) in §2, it follows that 

B(p, p) is independent of the choice of A + . (1-6) 

Hence it suffices to check (1.2) for one choice of A + . A more conceptual proof of (1.2) is 
based on the theory of "degenerate" theta functions (cf. Remark 6.1 in Section 6). 

Example 1.1. g = A(m,n) with m > n. Choose A + such that the number of odd 
simple roots is maximal. Then IT = IT' U IT", where (a\a) = if a G IT' and (a\a) = 2 if 
a G II", and one can order the sets IT' and IT": 



• 



IT = {ail, «2, • • • , «2(n+l) } 7 II" = {a 2 n+3, • • • , ttm+n+l} 

in such a way that all non-zero scalar products of distinct roots are: 

(a 2 j-i\a 2 j) = 1 if 1 < j < n + 1, (a 2 j\a 2 j + i) = -1 if 1 < j < n, 
(aj\aj+i) = — 1 if 2n + 2 < j < m + n. 

In particular, IT' (resp. IT") is a set of simple roots of A (n + 1, n) (resp. A m - n -i). The root 
system Aq is of type A m and has the following set of simple roots: {a\ + a 2: . . . , a 2n +i + 
a2n+2, «2n+3, • • • , «m+n+i}- In the (most important for us) case when m — n+1, we have 
IT = IT and Aq has simple roots {a\ +a 2l . . . , a 2n+ i + a 2n + 2 }. Note that (1.2) for A(m, n) 
follows from the "strange formula" for A m - n -\. 
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§2. The Weyl denominator of g. 

Given a subset of positive roots A + of A and a simple root a, we may construct a 
new subset of positive roots (cf. [PS2]): 

A' + = r Q (A + ) if (a|a)#0, 

A^ = (A+ U {-a}) \ {a} if (a|a) = 0. 

The set A^_ is called a simple reflection of A + . Then one has: 

p — a if (a\a) ^ 



(2-1) p ' \p + a if (a|a) = 0. 

Note that A' + and A + are VF-inequivalent if (a\a) = 0. By a usual argument, any two 
subsets of positive roots of A may be obtained from each other by a sequence of simple 
reflections. 

By a regular exponential function on f) we mean a finite linear combination of expo- 
nentials e A , A G ()*. A rational exponential function is a ratio P/Q where P and Q are 
regular exponential functions and Q ^0. The Weyl group W acts on the field of rational 
exponential functions via e A h- > e w ^ x \ w G W. 

The rational exponential function 

(2.2) i*= n (i-e- a ) I n a+e- a ) 

a£Ao4- / aeAi_|_ 

is called the Weyl denominator of q. Introduce also the Weyl superdenominator: 

k = n i 1 -^)/ n (i-o 

aeA + / a£Ai + 

(2.3) 

= n a-o n ( i + e_a )/ n (!-o- 

aeA 0+ aeAi + \A i+ / a£Ai + 

The proof of the following lemma is straightforward. 
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Lemma 2.1. Let A + and A' + be two subsets of positive roots in A, and let R and R' 
(resp. R and R') be the corresponding Weyl (resp. super) denominators. Then 

e p R = (-l)l A °+ nA o+l e ^i2', e p R = (-l)^»+ nA '°+\ e p ' R' . 

The basic difference between the Lie algebra and superalgebra cases is that the re- 
striction of the bilinear form (.|.) to the subspace V := Yl Rcc may be indefinite; the 
dimension of a maximal isotropic subspace of V is called the defect of $j and is denoted by 
def 0. Here is a list of defects 

A(m — l,n — 1), B(m,n), D(m,n) : def $j = min(m, n) 
C(n),D(2,l;a),F(4),G(3) : def = 1. 

(Note that def g = iff q is a Lie algebra or a Lie superalgebra 5(0, n).) 

A subset S of A is called maximal isotropic if it consists of def q roots that span 
a maximal isotropic subspace of V. The following can be checked by a straightforward 
calculation. 

Lemma 2.2. (a) A maximal isotropic set of roots always exists. 

(b) Given a maximal isotropic subset of roots S there exists A + such that S C II. 

(c) Given two maximal isotropic subsets of roots S = {/3i, . . . ,/3 s } and S' = 
{(3[, . . . , P' s }, there exists w G W^ such that w(f3' i ) = ±(3 a ^ for a permutation a. 

(d) Let S C Ai + be a maximal isotropic subset and let Aq + = {«G Ao+lct-L.S}. Then 

\A 1+ \S\ = \A 0+ \A^ + \. 

Theorem 2.1. Let S be a maximal isotropic subset of roots and choose A + such that 
S C II. Then 



(2.4) e p R= J2 < 



w)w 



rwi+e-^ 



weW t lines' 

This theorem is a special case of Theorem 3.1 in Section 3. 

Here we shall give a proof in the case def = 1. The proof is based on the following 
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Lemma 2.3. Suppose that an irreducible Q-module with highest weight A 6 I)* is a 
subquotient of a Verma Q-module M(A). Then there exists a sequence of weights Ao = A, 
Ai, . . . , Afc = A of M(A) such that Xi (0 < i < k) is obtained from Aj_i in one of the 
following two ways: 

(i) Xi = Xi-i - wji, where 7; G A 0+ and (Aj_i + p\rf) = n G N, 

(ii) Xi = A;_i - 7i, where 7, G A i+ and (Aj_i + p^) = 0. 

Proof. See [K4, Theorem 3b]. (Note that the exponents in the determinant formula given 
by [K4, Theorem 3a] should be corrected as in [K8].) ■ 

Proof of Theorem 2.1 (case def q = 1.) As usual, we have: 
(2.5) e p R = J2 c Ae A+p , c x G Z, c A # 0, 

where F is the set of weights described by (i) and (ii) in Lemma 2.3 for A = 0. Choose 
A + such that IT contains a unique odd (isotropic) root, say, (3. We clearly have: 



(2.6) J2 c -iP e 



P-JI3 



1 + e-P' 

j>0 

Consider the minimal i for which the possibility (ii) of Lemma 2.3 might occur. Then 
Xi-i = w(p) - p, where w = r 7i-1 ...r 7l G W and A; = A;_i - n, (p|to _1 (7i)) = °, 
7i G Ai. But by a case-wise inspection, (p\"f) = 0, 7 £ Ai ^ 7 = ±/3. Hence 7$ = w((3). 
Consider now the minimal j < i — 1 for which 7, G" AL i.e., 7^ = 9. But (p|# v ) < 0, hence 
we conclude that w G WK Thus, Ai = w(p — (3) — p, w G WK 

Furthermore, (f3\0 v ) > 0, hence (p — (3\6 y ) < 0, hence if s is minimal > i for which 
possibility (ii) of Lemma 2.3 might occur, we conclude that A s _i = w\{p — (3) —p, w\ G WK 

By a case-wise inspection, we see that (p—(3\(3i) — 0, (3\ G A i+ =3- (3i = (3. Hence A s = 
Wi(p—2f3), etc. Thus, the set A : = {A+p|A G F} coincides with the set {w(p—j(3)\w G W", 
j G Z+}. But by Lemma 2.1, w(e p R) = e(w)e p K. This together with (2.6) completes the 
proof. ■ 
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Remark 2.1. Recall that e(w) = (— l) m , where m is the number of reflections with re- 
spect to roots from Ao+ entering in a decomposition of w as a product of reflections. We let 
s(w) = (— l) m , where m denote the number of reflections occurring in this decomposition 
with respect to roots from Aq+. Then one easily deduces from (2.4) the formula 



(2.7) e'S= Y. '( 



e" 



w)w 

wew 



Upes^-e^) 



§3. Finite-dimensional irreducible g-modules. 

Let Ae [)*. The atypicality of A, denoted by atp A, is the maximal number of linearly 
independent roots fy such that (f3i\(3j) = and (A|/%) = for all i and j. Such a set {/3j} is 
called a X-maximal isotropic subset of A. (For example, a maximal isotropic subset S C II 
is a p-maximal isotropic subset.) 

Proposition 3.1. Given two X-maximal isotropic subsets {Pi} and {/^} of A, there 
exists w G W such that w(X) = X and w((3i) = =t/3£.(i) ^ or some permutation a. 

Let V be a finite-dimensional irreducible q module. If we fix a set of positive roots 
A_|_, we may talk about the highest weight A of V and about the p. If A^_ is obtained from 
A_|_ by a simple a- reflection, where (a\a) = 0, and if A' is the highest weight for A^_, then 
we clearly have 

(3.1) A' = A-a if (A|a)#0; A' = A if (A|a) = 0. 

Hence by (2.1) we obtain: 

A' + p' = A + p if (A + p\a)^0, 
(3.2) 

A' + p' = A + p + a if (A + p|a) = 0. 

Corollary 3.1. For the Q-module V, atp(A + p) is independent of the choice of A + . 
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Thus, we may talk about the atypicality of the g-module V: atpF := atp(A + p), 
which is independent of the choice of A+. Note that atp V < def g. 

Choose a A + p-maximal isotropic subset Sa in A_|_ and consider the following rational 
exponential function: 



E A := J]eW»(e^ ]J (l + e^)" 1 ). 
wew ^ /3eS A ' 



wew v /3eS A 

Denote by j A the coefficient of e +p in the regular exponential function 
riaeA 1+ ( 1 + e_a ) Ea and ' provided that j A ^ 0, let 

ch A =j A - 1 e- p R~ 1 X A , sch A =j A - 1 e- p R- 1 t A 
diniA = c1ia(0), sdiniA = schA(O). 

We shall write sometimes chA,A + ,s A ? • • • m place of cIia, ... to emphasize the dependence 
of A + and S A . 

Definition 3.1. The g-module V is called tame with respect to a subset of positive 
roots A + and a subset S A C A + , where A is the highest weight ofV with respect to A + 
and S A is a A + p-maximal isotropic subset of A + , if j A 7^ and the character of V is 
given by 

(3.3) chF = ch A ,A + ,s A • 

Remarks 3.1. (a) Formula (3.3) implies 



sch V — ± scIia a 



."+ 



,5 A 



Here + or — occurs according as the highest weight vector is even or odd. 
(b) If V is tame, then dimF = dimA, sdimV = ±sdimA. 
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Remarks 3.2. (a) Suppose that A^_ is obtained from A + by a simple a-reflection, where 
(cc\a) = 0. If (A + p\a) ^ 0, then c1ia,a + ,s a = c^a'.a' ,s a - ^ (A + p|aO = an d ct G II P) -Sa, 
we let S' A = (5a \ {a}) U{ — a }'i then chA,A+,s A = c^a.a' ,s' • This follows from (3.1) and 
(3.2). However, if (A + p\a) = and a G IT \ S'A, cIia^a' ,s a , ma Y be different from 
ch A ,A + ,s A - 

(b) Let S\ = {/3i, . . . , (3 S } and suppose y G W is such that y(A + p) = A + p, y((3i) = (3i 
for i = 2, ...,s, and y(/?i) = e(y)#, where $ G A+. Let S A = {/3[, /3 2 , • • • , A}- Then 
ch A ,A + ,s A = ch A , A+ ,s A - 

(c) Theorem 2.1 states that the 1-dimensional g-module is tame with respect to 
(A+, S ) if n d 5 . Note that then 

(3.4) j = \W/W*\. 

The number jo is listed below: 

A(m, n)(m > n) : (n + 1)!; B(m, n) : n\2 n if m > n, 2 rn m\ if m < n; C(n) : 1; 
D(m, n) : n\2 n if m > n + 1; 2 m " 1 m! if m < n + 1; D(2, 1; a), F(4), G(3) : 2. 

Proposition 3.2. Let V be a finite-dimensional irreducible Q-module. Choose a set of 
positive roots A + and let A denote the highest weight ofV. 

(a) (cf. [K4]) Let V be a typical Q-module, i.e., (A+p\a) ^ for a G Ai (equivalently: 
atp V = 0). Then V is tame with respect to (A + , 0). 

(b) (cf. [BL], [JHKT2, VJ2]) If Q is of type A(m,n) or C(n) and atpV = 1, then V 
is tame with respect to (A + , S\) for any choice of Sa and ja = 1. (Note that atpF = 
or 1 if g is of type A(m, 0) or C(n).) 

(c) If(A + p\a) > for aii a G A 0+ or (A + p|o) > for all a G A 0+ and atp(A + p) = 1 
then j A - 1. 

Proof. If V is a typical g-module, then formula (3.3) with Sa = and some j'a > 
follows from the description of singular weights of the Verma module M(A) and VF-anti- 
invariance of e p Rchl/ (cf. [K4]). But if j\ ^ 1, then the stabilizer of A + p in W is 
non-trivial, and since it is generated by reflections, we would get that chl/ = 0, which is 
impossible, proving (a). 

(c) is clear and (b) follows from [BL, JHKT2, VJ2] (or as above). ■ 
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Theorem 3.1. Let V be a finite-dimensional irreducible Q-module with highest weight 
A with respect to a subset of positive roots A+. If Sa C II C A+, then the Q-module V is 
tame with respect to (A+, S\). 

Note that Theorem 2.1 follows from Theorem 3.1 and Remark 3.2b. 

Example 3.1. If atp V = 0, then S\ = and Theorem 3.1 gives the well-known character 
formula of a typical g-module (c/. Proposition 3.2a). 

Example 3.2. If atpV = 1 and g is of the first kind, i.e., of type A(m,n) or C(n), 
then one can always choose A + such that S\ C IT, hence by Theorem 3.1 the g-module 
V is tame (cf. Proposition 3.2b). There exist, however, modules of atypicality 3 over 
A(4, 3) that are not tame for any choice of A + and S\ (examples were provided by J. Van 
der Jeugt). 

Example 3.3. Let now g be of the second kind, i.e., of type B(m, n), D(m, n), D(2, 1; a), 

G(3) or F(4). We exclude B(0,n) for which all V are typical. Let A+ be a standard set 
of positive roots. Here are the corresponding Dynkin diagrams [K2, p. 56]: 



B(m, n), m 


>0 


o- 


-0-----®2-02--.. 


"02^02 


B(0,n) 




o- 


-o-----o-o=»o 


Oi 


D(m, n), m 


> 2 


o- 


-0-----®2-02--.. 

Oi 


-02 

Oi 


D(2,l;a) 




2 ® 


Oi 




G(3) 




®2 - 


"04^02 




F(4) 




®2 " 


- Os <= O2 - Oi 





Let 9 be the only simple root of Aq+ which is not in IT; its coefficients in terms of IT are 
given above (note that 9 = 9 in all cases except for B(m, n) and D(m, n) with n > 1). Let 
b = — (p\9 v ) (as usual, o v := 2a/(a\a) for a G Ao); the values of b are as follows: 

B(m,n) :m-\, D(m,n):m-1, D(2,l:a):l, G(3) : |, F(4) : 3. 

Let V be a finite-dimensional irreducible g-module and let A be its highest weight. Let 
k = (A\9 V ). Recall that dimF < 00 implies that hi := (A\a%) G Z + for all ai elJf]A 
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and that k G Z+. For k > b these conditions are sufficient, and for k < b there are 
some extra conditions listed in [K2, p. 84] (note that b there slightly differs from b here). 
Suppose that atp V — 1 (this is always the case for a non-typical V over g of type B(m, 1), 
B(l,n), D(m, 1), .0(2, l;a), G(3), and -F(4)), and let 5"a = {/3} (the choice of (3 may not 
be unique). We have: j\ — 1 if k > b and j\ = 2 if k < b. If the g-module with the 
highest weight r^A + p) — p is not finite-dimensional (which is always the case when k <b 
or k > 26), then V is tame, i.e., 

ch V = cIia . 

Otherwise we have: 

ch V = ch A - ch r _ (A+p) _ p . 

Furthermore, provided that the highest weight vector is even, we have: 

sign(sdim A ) = (-l)^ w \ 

where w G W is the shortest element such that w((3) G IT. Here is a complete list of 
non-tame modules over exceptional Lie superalgebras (we write A = (k; &2, k^, . . .)): 

D(2,l;a): A = = (2; 0, 0) : chl/ = ch e -1. 

G(3) : A = (3; 0, n) : ch V = ch( 3; o, n ) - ch (2; o,n) • 

A=(5;0,0):chy = ch (5;0 ,o)-1. 
F(A) : A = (4; 0, n, 0) : ch V = ch( 4; o, n ,o) - ch (2; o,n,o) • 

A=(6;0,0,0):chy = ch (6;0 ,o,o)-l- 

In the case of .0(2, 1; a) this result is consistent with [VJ1]. 

A proof of these results will be given elsewhere. Here we note that the same proof as 
of Theorem 2.1 shows that for q of defect 1 and atypical V with the highest weight A such 
that (A + p\j3) — 0, f3 G A i-|- and such that k < b for q of the second kind one has: 

(3.5) e p RchV= Yl <w)w(e A+p /(l + e- f3 )). 

wewt 

Given integers a and b such that — 1 < a < 6, we let 

(3.6) C(a, b) = J2 26 " J \) if a > °5 c (~h b) = S_ ljb 2 b+1 . 

Let A^ e = |A e+ |, e = or 1. 
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Theorem 3.2. Let A G f)*, and let Sa = {Pi, ■ ■ ■ ,Ps}- Then (here and further \k\ 
stands for J2i ki): 

dimA = !!^ E (-d^Ui + s - hNo + ._d n (a + p-E,^.I«) 



JA ~ f/ (Po|«) 

fe|<iV 

The proof of the theorem is based on the following simple lemma. 
Lemma 3.1. Let P(x±, . . . ,x s ) be a polynomial of degree < d in the indeterminates 

X\i • • • 7 x s . 

(a) In the domain \xi\ < 1 one has 

//c_ -■■ ■ , i. ■, . ' 7 = 1 J 



Here and further we use the usual notation: 



-m, ri\ n s I Tl \ / ^1 \ / ^s 



ry> rtf - 1 - rtr> 



(bj The value of the rational function on the right-hand side of (3.7) at x\ = . . . = x a — 1 
equals 

(3.8) 2~ s - d J2 (-1) N C(N +s-l,d + s- l)P(i 



|n|<d 



Proof. It suffices to prove (3.7) for a polynomial P(x) = I . ) , < j < d. But this 
follows from the well-known formulas: 



E(- 1 ) fc (jj)f*) = (- 1 ) B ^ 



A — " ' ' '' 



> (— x) n ( . ) = r~TT in the domain \x\ < 1. 



(b) follows from (a) and the formula 

V^ / n\ ( A/ +.s - 1 



Rez^ 



|ra|=AT 

Remark 3.3. It is clear from the proof that one can take the summation over n in 
the right-hand side of (3.7) and in (3.8) over the set [P] G Z^_ defined as follows. We let 
[x a ] = {b G Z^_|6i < a,i} and let [P] be the union of [x a ] over all the monomials occuring 
in P with a non-zero coefficient. 
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Proof of Theorem 3.2. Given A G f)*, define the specialization F t \ by 

F tx (en=e t ^\ /zefj*. 
First, we compute the following specialization, where \xi\ < 1 for all i and 

^o = n aeAo+ ( i -e- a ): 






e A+P 



> e(w)( 



t(w(A+p-n 1 Pi-...-n s (3 s )\p ) 

El -]\\n\^n W€W 
1 } F tpo (eP°R ) 

^ [ } F tpo (ePoR ) 

Hence we have in the domain |xj < 1: 

,A+P 



— - > e(w)w=—, — 



lim F ton I — ^— - \ e{w)w=—. w- 

*-o tpo \ePoR 4-/ v ; n ,(l + xie-^ 



( 3 - 9 ) (A + P - E n *& 

= ^ (-i)i-i^ n — 



n 



n£Z^_ q£A i)+ vru| ; 

Note that the expression under the limit at the left-hand side of (3.9) is a continuous 
function in the domain \t\ < e and \xi — 1| < e for sufficiently small e. Hence we may 

calculate 

1 ^ , , e A +P 



limF ion > e(w)w^- r 

V u wew lliV 

by applying Lemma 3.1a to the right-hand side of (3.9) and then evaluating it at x\ = 

. . . = x s = 1 using Lemma 3.2b. Since diniA = lim^o F tpo cIia, we obtain the result. ■ 

Theorem 3.3. Let AgI)*, let S\ be a A + p-isotropic subset and let s = \S\\. Consider 
the root system Ma := {a G A |a _L S^}, let p A be the half of the sum of roots from 
M~y := M\ f]A + and let La (A) denote the irreducible module with highest weight A over 
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the reductive Lie algebra with root system M A . Let a = n — m — 1 for q of type B(m, n) 
with m < n and let a = in all other cases. Then 

(3.10a) |sdim A | = {W/W^^JX 1 dimL A (A + p - p° A ) if s = def g, 

(3.10b) sdiniA = otherwise. 

Proof. Let W A be the subgroup of W generated by reflections with respect to the roots 
from M A and let W\ be a set of left coset representatives, so that W = WiW A . Due to 
(2.3), formula (3.4) can be rewritten using the Weyl character formula for the root system 
M A as follows: 

j A 11 (l + e- a ) ]J (l-e- a Ksch A 

aeAi + \Ai + a£A 0+ 

TT /i p — w(a)\ 

= II i 1 -'-") £ 'W n ° a ~e-^r w i A chL ° (A + " ~ A) ) ■ 

For A G f)* such that (A|a) 7^ for all a G A, we apply to both sides of this equality the 
specialization F t \ to obtain as t — > 0: 

Ja2 |a 1+ \a 1+ | -q (A | a)sdimA = 

aeA 0+ \Ai+ 

£ |a 1+ |+|m+|-|A 0+ |-|Sa| J ^ ^ "Q (A|u;(a)) ] dimL A (A + p-p A ) + o(t). 

\weVKi a eM+\s A J 

Due to Lemma 2. 2d, if s < def 0, the right-hand side tends to as t — > 0, proving (3.10b), 
and if s = def g, we obtain as t — »■ 0: 

(3.11) sdim A = j' A lc (-^' A+, ^a) dimL A (A + p - p° A ), 
where 

(3.12) c(A,A+,S A )= J] (X\a) £ e» J] (A|«;(a)) 

a6A 0+ \Ai + >"6Wl a£M+\S A 

is a constant which, in fact, is independent of the choice of A (since all other factors in 
(3.12) are independent of A). It follows that the constant c = c(A, A+, S\) is independent 
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up to a sign of the choice of (A + , S\) as well. Recall now that, according to Theorem 2.1, 
the 1-dimensional module is tame with respect to a certain pair (A^_, S'). Applying (3.11) 
to the 1-dimensional g-module (for which sdim = ±1) and using (3.4), we obtain: 

1 = ±\W/W i \- 1 cdimL (p' - p° '). 

Finally a case by case inspection shows that dim L (p' — p[] ) = 2 a , proving (3.10a). 
In the case g = C(n) a formula equivalent to (3.10b) was obtained in [VJ2]. ■ 

Conjecture 3.1. sdiml/ = if and only if atpy < def g. 

Example 3.4. (a) if V is a typical g-module then formulas (3.6) and (3.10) turn into 
the known formulas [K4]: 

(A + p\a) 



dim V = 2 Nl ] | 



(Po|«) 



sdimF = if g^B(0,n), = ][ (A + p|a)/(p|a) if g = B(0,n). 

aEA + 

(b) Let g be an exceptional Lie superalgebra and let V be a finite-dimensional ir- 
reducible non-typical jj-module with highest weight A, so that atpF = 1. We keep the 
notation of Example 3.3. 

= D(2, 1; a) : (ai|ai) = 0, (ai|a 2 ) = -1, (ai|a 3 ) = -a, (a 2 \a 2 ) = 2, (a 3 |a 3 ) = 2a, 
(o^la^) = 0. Assume that V is neither the 1-dimensional nor the adjoint module. Then 
sdiml/ = ±2 and | dim]/ is given by the following formulas, where m = k 2 , n = k^: 

Akmn + 2k{m + n) — 2n + 1 if (3 = a 2 , 
Akmn + 2(km + 3kn — mn) + A(k — n) — 1 if (3 — a\ + a 2 , 
Akmn + 2(3km + kn — mn) + A(k — to) — 1 if (3 = a 2 + «3, 
Akmn + 2(3km + 3kn — mn) + A(2k — m — n) — 7 if (3 = ol\ + a 2 + CI3. 
(Recall that for a typical V one has [K4]: dim]/ = 16(m + l)(n-|-l)(&; — 1) and sdiml/ = 0.) 
g = G(3) (to = k 2 , n = k 3 ): 

If (3 = cti, then dimF = 1; (3 7^ a± + a 2 . If (3 = a.\ + a 2 + «3, then k = 2, m = and 
sdimF = 2n+3. If (3 = ai+3a2+a3, then 2k = to+6; for k = 3 we have sdiml/ = — 2n— 3, 
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for k > 3 we have sdiml/ = —2(m + 2n + 3). If (3 = a,\ + 3ct2 + 2ct 3 , then 2k = m + 3n + 9 
and sdimF = 2(m + n + 2). If /? = a± + Aa 2 + 2ct 3 , then 2k = 2m + 3n + 10; for k = 5 we 
have dimV = 321, sdimV = — 1, for k > 5 we have sdiml/ = — 2(n + 1). 

g = F(A) (/ = k 2 ,m = k 3 , n = k 4 ): 

If (3 = «i, then dimF = 1; (3 ^ a± + a 2 - If (3 = ol\ + a 2 + «3, then k = 2, / = n = and 
sdimF = (m + 2) 3 . If /? = ai + 2a2+«3, then 3/c = / — 2n + 8; if (3 = ai + a 2 +ct3+a4, then 
3k = 2n — I + 10; in both cases k > 3 and sdimF = — (m+l)(l+m+n+3)(l + 2m+n+A). If 
(3 = ai+2a2+«3+«4, then 3k = l+2n+12; if k — 4, then / = n = and sdimF = (m+2) 3 ; 
if A; > 4, then sdimV = (/ + m + 2)(m + n + 2)(/ + 2m + n + 4). If /5 = ai +2a 2 + 2a 3 + a 4 , 
then 3A; = I + Am + 2n + 16 and sdim V = -(I + m + 2)(n + 1)(/ + m + n + 3). If 
(3 = oc\ + 3a 2 + 2a 3 + ct 4 , then 3k = 31 + Am + 2n + 18; if k = 6, then I = m = n = and 
sdimF = 1; if fc > 6, then sdimF = (m + l)(n + l)(m + n + 2). 

§4. The denominator identity for affine superalgebras 
and its specializations. 

Let 0, as before, be a finite-dimensional simple Lie superalgebra over C of rank £ with 
a non-degenerate even invariant bilinear form (.|.) (see Section 1). Let g = C[t, t _1 ] © g © 
CC © Cd be the associated to affine superalgebra. The Z2-gradation of extends from 
that of by letting deg t — 0, deg C = deg d = 0. Denoting a(n) = t n © a for a G 0, n G Z, 
we have the following commutation relations (a, b G 0; m, n G Z): 

[o(m), 6(n)] = [a, 6](m + n) + mS m - n (a\b)C, 
[d, a{m)] — ma{m), [C, g] = 0. 

We identify with the subalgebra 1 © of 0. The bilinear form (.|.) extends from to an 
even invariant bilinear form on by: 

(a(m)\b(n)) = 5 m - n (a\b), (C[t, t" 1 ] © g\CC + Cd) =0, 
(C\C) = (d\d) = 0, (C\d) = l. 

Let \) = f) + CC + Cd be the Cartan subalgebra of and let n+ = n+ © ( © 7>0 V © f) 
We identify f)* with () using the bilinear form (.|.). 
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Given a subset S C f), we let S = {a + nC\a G S, n G Z} \ {0}. Then the set of 
roots of g with respect to F) is A = Ao U {0}~, the set of even (resp. odd) roots being 
Ao = Ao U {0}~ (resp. Ai = Ai). The set of positive roots of A associated to the choice 
of A + C A is A_|_ = A_|_ U {a + nC\a G A U {0}, n > 0}, the set of simple roots being 
il = {«o := C — 9} U H. As usual the subscript + means the intersection with A + , e.g., 

A+ = An A+. 

Define p G I)* by p = p + h w d. One has: 

(p\ati) - \{ai\a.i) for «» G ft, (p\d) - 0, (p\C) = /i v . 

As before, for a G A we let a v = 2a/(a\a). For a G [)* define t a G Aut [)* by 

t a (A) = A + A(C)a - ((A|a) + |(a|a)A(C)) C. 

For an additive subgroup S C f)* the set ts '■— {t a \a G S} is a subgroup of Autl)*. Let 
M(respM^) be the Z-span of the ct v such that a G Ao (resp. a G Aq). The Weyl group of g 
is W = W KtM- The following subgroup of W is more important, however: W^ = W k £ m o • 

Denote by T the field of meromorphic functions in the domain Y = {h G h| Re(C|/i) > 
0}. Since C is VF-fixed, the group W acts on T . Let g = e~ c ; note that |g| < 1 in F. 
Given A G 1)*, we extend it to a linear function A G ()* by letting A(C) = A(cf) = 0; this 
gives us an embedding of the field T of rational exponential functions on f) in the field J- ' . 

Let R be the Weyl denominator of g (see Section 2). Introduce the affine denominator 
by 

00 

R = R\\{l-q n Y nt 1- ^) Y[(^- + Q n e a )~ 1 . 

n=\ agAo agAi 

It is clear that R G T . As in Section 2, it is easy to check that 

(4.1) w(ePR) = e(w)ePR, weW. 

Here e : W — > ±1 is a homomorphism which extends the homomorphism e : VF — >■ ±1 by 

e(t M ) = 1. 
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Theorem 4.1. Suppose that h 7^ 0. Then 

(4.2) e p R = J2 ^(e^R). 

The proof of Theorem 4.1 is based on the following 

Lemma 4.1. Suppose that A E h* is such that (A + /3)(C) 7^ 0, and suppose that L(X), 
A G f)*, is an irreducible subquotient of the Verma g-module M(A). Then there exists a 
sequence Ao = A, Ai, . . . , A& = A such that Aj is obtained from Aj_i (0 < i < k) in one of 
the following two ways: 

(i) Xi = A;_i - n(3 i7 where fa G A 0+ and (X i - 1 + p\(3^) = n e N, 

(ii) Xi = Aj_i - fa, where fa G A 1+ , (fa\fa) = 0, and (Aj_i + p\fa) = 0. 

Proof. See [K6, Theorem lb]. (Note that the usual proof is based on the determinant 
formula given by [K6, Theorem la]; the exponents in this formula should be corrected as 

in [K8]). ■ 

A detailed proof of Theorem 4.1 will be given elsewhere. In the case def q = 1 the 
same proof works as that in Section 2. 

Theorem 4.2. Let q be a simple finite-dimensional Lie superalgebra with a non- 

degenerate Killing form, i.e., /i v 7^ 0. Choose a set of positive roots A + such that the set of 
simple roots contains a maximal set of pairwise orthogonal isotropic roots {fa, . . . , [3 s }(s = 
def 0). Let (3 = J2i=i A an d let d e = dim$j e , e = or 1. Then 

(a 31 TT (1 ~ gJ)d ° = 2Nl V i^ v H«)+(p+/3H V Aa ^ 

1 • ] f\ (1 + «*)* \W/W*\ ^ m q ^ n,(l + q^) n > +1 ' 

\ft\<N 

where 

n\ tt (p + h v a-kifa k s [5 s \^) 



(4.4) AJfi) = £ (-I)* (f) n 



hei B x ' 7 eA + 



(P0I7) 



Proof. From Theorems 2.1 and 4.1, and Remark 3.2c we have: 

IW/WIR ,. e~P v^ v^ , , eP 
(4.5) J — ' = hm — — > > e(w)wt a ^=r-, ttt- 
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Assuming that \xj\ are sufficiently small we expand in a geometric progression for each a: 

Ll 3 K J ' n€Z B + j 

Hence we may rewrite (4.5) as follows: 

\W/W*\R 



lim > q 2 

ePoR Xl ,...,x s ^i *-* ' 



l^ v (a|a) + (p|a) 

ceeMi 



I • ) v f ( 1 ..\ p w (P+ hVa -Y. j n if 3 ^-P 

-(a\!3j)\nj l^weW H^je J _ 



x J2 Ili-xtf 



n£Z; J 



ePoR 
Applying the specialization F tpo to both sides and tending t to we obtain: 

\W/W*\ ^r (1-Q n ) dim0 ° 

2^1 11 (1 -f o^)dim0i 

n=l 

The theorem now follows from (3.7). ■ 

Theorem 4.3. Let q be a simple finite-dimensional Lie superalgebra of type A(m,n) 
m 7^ n, or C(m). Then in the notation of Theorem 4.2 one has: 

(l- q J)do q r+\s ^ i h v Ma)+( p+0]a) ^ A a (n) 



(4-7) i\( 1 + Q j-h)d 1 \w/wn ^ q 



— ; 1_^. — _ x q2' u *."i"; ' \y ' ^\^> \ ^ — '. 

[(i + *-*)* \w/wt\J^ s q A, uAi + ^^) 

\n\<Nr, V / 



where r is the number of roots from Ai + which are negative with respect to the standard 
set of positive roots. 

Proof. Let A G t)* be such that (A|ct) = if a G Ao and (A|a) = \ if a is odd and positive 
with respect to the standard set of positive roots. Now apply to both sides of (4.6) the 
specialization -Ft Po -(i og q)A an d tend t to 0. ■ 
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Example 4.1. Let q = sl(2, 1). Choose A + such that both simple roots ol\ and oli are 
odd. Then (ai|ai) = (ct^ct-i) = 0, (ai\a 2 ) = 1, p — 0, W — 1, M* = Z(cti + a^)- We let 
a; = e _ai , y = e _a2 . Then (2.4) becomes (if we take (3 = ol\ or «2 respectively): 

1 — xy 1 y 1 x 



(l + x)(l + y) 1 + x 1 + y 1 + y 1 + x' 

Formula (4.2) for R becomes after expanding the right-hand side (for which we assume 

\q\ < \x\, \y\ < 1): 

^r (l-Q n ) 2 (l-xyg n - 1 )(l-a;- 1 y- 1 Q n ) 

J-J- (1 + xq 71 ' 1 )^ + x- 1 q n )(l + yq 71 ' 1 )^ + y^q 71 ) 
(4.8) " ' ' 

E - E ) {(-ir +n x m y n q mn ) . 

\,m,n=0 m,n= — 1/ 

This truly remarkable identity may be viewed also as the denominator identity for N = 4 
superconformal algebra. An equivalent form of (4.8) is (here we assume \q\ < \x\ < 1): 



n 



(i-q n ) 2 (i-xyq n - i )(i-x- i y- i q n ) v^ (-xy 



^ (l + x^- 1 )(l + x- 1 Q n )(l + yQ n - 1 )(l + y- 1 Q n ) ^ l + yq j ' 

Replacing in this formula q by q 2 , x by z and y by gz _1 , we obtain 
oo (l-o w ) 2 v ^ q n(n+l)/2 

TT — — = V(-ir- 

11 (l + q n - 1 z)(l+q n z- 1 ) ^ ' l + q n z 

n=l v * / \ i / n£Z * 

This identity may be viewed as the denominator identity for N = 2 superconformal algebra 
and also of the affine superalgebra gl(l,l) A . It also has been rediscovered many times 
(see, e.g., [KP]). It is worth mentioning here that Gauss identities (5.1) and (5.2) are 
denominator identities for N — 1 superconformal algebras. 

Yet another useful form of (4.8) is obtained by dividing both sides by R: 

-^ (l-Q n ) 2 (l-xyg n )(l-x- 1 y- 1 Q n ) 
Al (1 + xq n )(l + x~ 1 q n )(l + yq n ){l + y _1 g n ) 

= i + \ Z^A +y > J2 (-l) m+n q mn (x rn y n - x~ m y- n ). 



(1 — xy) 

m,n=l 
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Letting x = y = z, we obtain: 

(l-q n ) 2 (l-z 2 q n )(l-z- 2 q n ) 



n 



(1 + zq n ) 2 (l + z- l q n ) 2 
(4.10) 



m-\-n „—m — n 



l + (l + z) ^ (-l) m+n ? mn 



2"" r " - z 



1-z 

m,n=l 

Example 4.2. Let q = osp(3, 2). Choose A_|_ such that both simple roots a± and «2 are 
odd; one has: (ailct^) = 0, (a2|«2) = §, («i|o ; 2) = — \i P = ~ |«i) ^ v = §, -^ = 2Zct2. 
We let x = e - " 1 , y = e _a2 . Then (2.4) becomes: 

R ._ 0--v)0-- x v) _ 1 y 



(1 + x) (1 + xy 2 ) 1 + x 1 + xy 2 
Formula (4.2) for R becomes after expanding the right-hand side (as before, \q\ < \x\, 

|y|<i)= 

^ (1 - Q n ) 2 (l - xyg n_1 )(l - x" 1 ?/- V)(l - 7/V _1 )(l - y~V) 

J-A (i _|_ X g n - 1 )(l + x~ 1 q n )(l + yq 71 - 1 )^ + y -1 g n )(l + xy 2 q n ~ 1 )(l + x~ x y- 2 q n ) 

(oo — oo \ 

£ - Z) (-x) n (y- m -y m+2n+1 )^ m(m+2n+1 ). 
771, n=0 m,n= — 1/ 

Here is a general construction of a specialization (c/. [K9]). Let cr be an automorphism 
of order m of g such that a(/i) = h for /i G h, let g = © ?6 ^/ m zSe,j (e = or 1) be the 
corresponding Z/mZ-gradations and let d e j = dim0 £)J -. For a G A we have $j Q C e ,s Q ; let 
s a G Z be such that < s a < m, s a = s a modm. Define A G f) by (X\a) = s a . Replace 
q by q m in (4.2), divide both sides of it by Yi <*e A o+ (1 — e~ a ) and apply to the resulting 

(A|°0=0 

identity the specialization F a := F_(\ ogq -)\. The left-hand side becomes 

Y[(l-q j ) do - i /(l + q j ) dl -'. 

One can generalize the trick applied in the proof of Theorems 4.2 and 4.3 to evaluate 
the right-hand side (as in [K9]). However, the answer is simpler when A is fixed under 
the action of W (as in Theorems 4.2 and 4.3). Another situation when this trick may be 
applied is when s a = for a G Aq and s a ^ for a G A \ Aq, so that A is fixed under 

wK 
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Example 4.3. (a) Let a be the automorphism of g such that cr| 0o = 1, a\ 8l = — 1. Then 
applying F a to R/Rf, gives an expansion of HL^n^ ~~ 9 2j ') d °/(l — g 2j ' _1 ) dl , which is A(g) d ° 
(see (5.2) below) provided that do — d\. 

(b) Let g — A(n, n — 1) and choose A + such that IT consists of odd roots {«i, . . . , «2n} 
(see Example 1.1). Let a be such that s a2 . = 1 and s CC2j _ 1 = (j = 1, . . . , n). Then F a 
gives an expansion of \3{q) 2n over an n-dimensional lattice. Namely, using the same 
method as that in the proof of Theorem 4.2, we obtain: 

n — i 

n(-qf n = 2 n V ^(-l)l s lg I ^ 1 ( a l a ) + ( Q l«')-(«|S)TT /' 1 + g (n+l)(a|/3 J )-( S -|/3 J ) N \ 
a£Mt seS j = l 

where § is the set of all subsets in Ao+, and \s\ (resp. s) stands for the number (resp. 
sum) of elements of s E S. Note that M^ is an n-dimensional lattice (of type A n ), so that 
for n = 1 we recover Jacobi's formula (0.1), but for n = 2, 3 and 4 our formula is more 
complicated than Jacobi's (0.2-4). The way to recover Jacobi's formulas will be explained 
below. 

(c) Let g = A(2n + l,2n) = sl(2n + 2,2n + 1) and let a be the conjugation by 
the matrix diag(/ n +i, — I n +i', In+i, —In)- Then a is an order 2 automorphism of g such 
that <io,o = do,i = rfi,o = ^1,1 = 2(n + l)(2n + 1). Hence F a gives an expansion of 
|— l^-j2(n+i)(2n+i) Qver an n _|_ l-dimensional lattice (n = 0, 1, . . .). 

Example 4.4. Let g = A(m, n) with m > n. We choose the set of simple roots as in 
Example 1.1. Then formula (4.2) can be written, using (2.4) and (3.4), as follows: 

1 / n+1 

(4.12) e ^=7r-Tu E E eMwt-aUlKl + e-"*-*)- 1 

{ >' aEMiweW \ j = l 

where M* is the lattice spanned over Z by elements 0:2^-1 + «2j (j = 1, • • • , n + 1) and ckj 
(2n + 3<z<m + n + l). Introduce the element ^ G h by relations (C\ a j) — (~ l) J /2 for 
1 < J < 2(n + 1), (C|«j) = for 2n + 3 < j < m + n + 1. Then (f |a) = for all a G A , 
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hence t% commutes with W. Applying t% to both sides of (4.12) we obtain (assuming 
|g|<l): 



«****• = (STiji n e - e (-d e « 

(4.13) v^ V^ / \ 0-/» v a-5™ +1 r,-«ai-i 



fc„ +2 ,---, fc m6z; wew 



x g 



^ v («| a )+y^™+ i 1 r J (fc i + i)-y^;'l 2 fc i -I(n+l)(2m-n) 



Here 



K T . Ro n n «- (i -^ 



n=l 



n aeAl (i+? n -^ c 

/3 is the sum of the 7 G Ai + such that (7IO = \, 

n+l m 

a = ^ fcj (Q!2j-1 H h «2n+2) + ^ kja n+ i +j 

3=1 j=n+2 

(so that (/3|a) = J2T= n +2^j)- Dividing both sides of (4.13) by Ro and letting e ai ^ 1 
(i = l,...,m + n+l), we obtain (using the Weyl dimension formula) a power series 
expansion for the product YlTLi 0- ~ 9 J ) ° / ( 1 — 9 J_ 5 ) • Furthermore, applying £_£ to 
both sides of (4.13), we obtain a better expression for the affine denominator: 

e '*=(^Tl)! E E E ej(k^{-l)^^ 

JC{l,...,n+l} (k,f)eSj fcn+2,---,fe m eZ 

(4-14) . bV V 

Ee ^i£J J ^ J i/jV/iN.y^ r . A ,._V^ m k 

e(w)w a 2 ^i6J 3 3 ^,j=n+2 J 

Here 

Sj = { (/c, f) . eJ G Z 2|J| kj > and r,- > 0, or fej < 0, r,- < for each j E j\ , 
ej (£,f) = (_i)«O'eJ|fc,-<0} and j c = {i,2,...,n+l}\ J. 

Note that (p — /i v ct — Y^ijej r j a 2j-i\ a 2i-i ) = if z G J c . Hence, by dividing both sides 
of (4.14) by Ro and letting e ai 1— >■ 1 (i = 1, . . . , m + n + 1), we may use Theorem 3.2 to 
obtain a power series expansion for YYjLi (l ~~ 9"0 ° / (l + <Z"0 *• 
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Example 4.5. Let q = B(m,m). We choose a set of simple roots a±, . . . ,a2 m £ Ai 
with the following scalar products: (ai\ai) — for % — 1, . . . , 2m — 1, (a2m|«2m) = — l/2, 
(aj|o!j + i) = (— l) l+1 /2 for i — 1, ... , 2m — 1. We have: h y = 1/2 and M$ is spanned over 
Z by vectors 2 (ct2j-i + Q^j), J ' = 1, • • • , fn. Then formula (4.2) can be written using (2.4) 
and (3.4), as follows: 

(4.15) e ^=^T £ £ e ^"« ( e 'il( 1 + e " a2j - 1 )" 1 ] • 

Introduce the element £ G t) by relations (£|<x,-) = (— l) J /2 for j = 1, . . . , to— 1, (£|ct2m) = 0. 
Then ■&>(£) — £ G M* for all to G W. Applying t^ to both sides of (4.15) we obtain a more 
convenient for specializations formula: 

1 I m I oo — oo \ \ 

'^=in e - e (-i)*"*"**^." 



e 

2 m m! , 

ij'=l \fcj,rj=0 kj,rj = — 1 
( 4 - 16 ) v V- / x P+i(C-a)-E m ^2,-1 

wEW 
x i(«l«)+E™i( fc i( r i+ 1 )+3 r i)-i m ( m - 1 ) 

where /? = §£ + E 7eAl+: ( ? | 7 )=± 7 - E 76 a 0+: (£| 7 )=-i 7 and a = 2 E™=i k j £Sy-i «<• 

§5. Applications to sums of squares and sums of triangular numbers. 

Consider the following power series in q (that converge for |g| < 1): 

D(,) = ^^ 2 , A(q)= J2 Q n(n+1)/2 - 

One has the following product expansions due to Gauss (which follow immediately from 
the Jacobi triple product identity): 



(5.i) □(-?) = n i 



1 _ qk 



fe>i H 



(5-2) A(q) = J] T 



1-g 



q 



2 A: 
2fc-l 



fc>l 

Let Aj = j(j + l)/2 and let A = {Aj\j G Z + } be the set of triangular numbers. Let 
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n N , k = \{n G Z N \Y^ =1 n 2 j = k}\ (resp. A^ = \{n G A^IEL^ = *}|) be the 



number of representations of k as a sum of N squares (resp. triangular numbers). Let 
^n(q) = J2kei ^N,kQ k and A;v(g) = J2kei, ^N,kQ k be the generating series for these 
numbers. Then, clearly 

n N (q) = n(q) N , A N (q) = A(q) N . 

Thus, in view of (5.1) and (5.2) we may use the results of Section 4 to obtain expansion for 
□jv(<?) and A;v(<?)- In fact, formulas (4.3) and (4.7) give such expansions provided that 
do = d\, which happens for g of type A(n, n — 1), B(n, n) or D(n + 1, n+ 1). These gives 
us formulas for DjvC?) and Ajv(g), where respectively 

N = 2n(n + 1), 2n(2n + 1) or A(n + l) 2 (n G N). 

Example 5.1. g = A(1,0). Letting z — ► 1 in (4.10) we get: 







□(-# 


= 1-4^ (-l) m+n (m + n)q mn 
m,n—l 

oo 

= 1 + 8 ^ (-l) m+n - 1 mq mn 

m,n=l 

Z^ l + g"» • 

771 = 1 


2mq 2m 
l + q' 2m 


_ 2mq 2m 
l-q 2m 


Amq 4 -™ 
l-g 4m ' 


, we obtain: 



fe>l " 

A\k 



which is Jacobi's formula (0.2). In other words, for n > 1: 

□ 4 ,n = 8^/c. 

fc | n 
4ffe 

Letting z = i in (4.9), we get Jacobi's formula (0.1), i.e., that D2, n equals 4 times the 
difference between the number of divisors of n congruent to 1 mod 4 and the number of 
divisors of n congruent to —1 mod 4. This result goes back to Gauss. 
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Letting in (4.9) x = —y = q 1 ^ 2 , we obtain: 

OG 

A(g) 2 _ \~^ (_ 1 ^ ? ((2j + l)(2fc+l)-l)/4_ 
j,k=0 

This means that A2, n equals the difference between the number of divisors of An + 1 
congruent to 1 mod 4 and the number of divisors of An + 1 congudent to —1 mod 4. 
Replacing in (4.9) q by q 2 , letting x = —qz, y = —q and tending z to 0, we get 

oc 

A(q) 4 =J2(2k + i) 9 ((2j+i)(2fc+i)-i)/2_ 

This means that A4 ;W equals the sum of all divisors of 2n + l. This result is due to Legendre 

(1828). 

Example 5.2. g = B{1, 1). Dividing both sides of (4.11) by (1 — xy)(l — y) and letting 
x = y = z — ► 1, we obtain Jacobi's formula (0.3). In other words, 

□ 6 , n = 4 J2 (-l)^' +1) (j 2 -4fc 2 ). 
i,fe>i 

j odd ,jk — n 

Furthermore, replacing in (4.11) q by q 2 and letting x = y = —qz, we obtain after dividing 
both sides by (z — l) 2 and letting z — > 1: 

j, fc odd 

j>fe>l 

^(j-fe)odd 

In other words, as can be easily seen: 

j > k > 1 

jfc=4ra+3 

Example 5.3. = A(m,m — 1). Dividing both sides of (4.13) by R , letting e a " — > 1 
(z = 1, . . . , 2m) and replacing qs by — g, we obtain 

e - e n^ n (n-rAM-!) 

k,re1^ k,fe(-N) m J i = l \l<i<j<m 

xg 2 E 1 < t < J < m fc '^+E™ 1 ^( 2 ^+ 1 )- m ( m + 1 )/ 2 ) 
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where 



(5.3) 



r 'j =rj + kj. 



Similarly, we obtain from (4.14) using the remarks and notation of Example 4.4: 

I 1 N i77l(77l+l)Q771 \-^m 

u(- q) ^^ = { -v 2 E E E ^V)(-i) E - r ' 

n 3 =lU-) JC{l,...,m}(r,-) J - eJ c(fc if ) e5j 

x 2"I JC IC I E ^ + kl " 1, ™ 2 + I J c \ ~ 1 ) fl {r'j + h + ■ ■ ■ + k m ) 
\ieJ c J j=i 

x n ( Ti ~ r ^ ( r i ~ r 'j) q i - i - j ~ m kikj+ ^^j kjrj 



l<i<J<771 



Example 5.4. q = B(m,m). Dividing both sides of (4.16) by R , letting e ai — > 1 
(i — 1, . . . , 2m) and replacing q? by — g we obtain (using the Weyl dimension formula): 



A(9) 



2771(2771+1) 



1 



/ 



2 m m! 



e e n 



(-1)' 



L i ((2j - I)!)" 



.(l + 2r J )(l + r'[ 



x 11 (r l -r J )(r' i -r' J )(l+r t + r J )(2 + r' l + r' J ) 



x g 



l<i<J<771 

Er=i(^ 2+2r ^ j+2fcj ' +rj ) _ i m(m " i) 



Conjecture 5.1. 



A(9) 



2771(2771+1) 



"»'(n™iW-i: 



E (-H 



fc,r€Z™ 



x fl (r l -r J )(r' l -r' J )(2 + r' % +r' J )(l + r l + r J ) 

1<7<J<771 



X 



771 

fr (1 + 2r 3 ) (1 + /) g Er=i(( fc ? +2 ^)+(^( 2fc i+ i )))-5-(--i)_ 



i=i 
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§6. Some "degenerate" theta functions and modular forms. 

In this section we use the denominator identity (4.8) for sl(2, 1) A to derive transfor- 
mation properties of certain "degenerate" theta functions and modular forms, and related 
to them characters of iV = 2 super confer mal algebras. 

Let q = e 2lTlT where Imr > 0, and let 0(r, z) be the standard Jacobi theta function: 
0(r, z ) = e 7riT / 4 e - 7ri2 Y[ (! - Q n ) i 1 ~ q n e~ 27rtz ) (l - q n ~ 1 e 2ltiz ) 

n>l 

= J2(-l) J q^ J -^ 2 e 27T < J -^ z . 

Recall that this theta function has the following transformation property (see, e.g. [K9]): 

Introduce the following function in r, z\, and z 2 : 

( , v(t) 3 Q(t,z 1 + z 2 ) 

£ (T, Zi, Z 2 - —t- ( rp- r-, 

where 77(7-) is the Dedekind ^-function. Note that F(r,zi,Z2) is the left-hand side of 
identity (4.8) where x = -e 27riz \ y = -e 27TiZ2 . 

Fix a positive integer m. Using the transformation formula for © and identity (4.8), 
it is not hard to derive the following transformation formula: 

,_, / 171 Z\ Z 2 \ T 2tjz 1 z 2 ^-^ 27r I (g Zl +bz 2 ) ab 

(6.1) F[ , — , — = — e mT } e m q m Flmr, z\ + ar, z 2 + or). 

V t t t J m *-^ 

a,beZ/mZ 

Given j, fcG |Z, introduce the following functions: 

F j,k {T,z) = q™e ™ F [rriT, -z + jr - z ± z ,z+ kr + z =F ±) . 

We call them degenerate theta functions since, due to (4.8), they have the following power 
series expansion associated to a bilinear form representing zero: 

(oo — oo \ 

]T - J^ ) (±l) b - a q m ( a+ ^ b+ ^e 2 ™(( b+ ^-( a+ ^>. 
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Transformation formula (6.1) implies the transformation formulas for indefinite theta 
functions. In order to state them introduce the following sets: 

Ki = {{j,k) eZ 2 \0<j,j + k<m, 0< k<m}, 
Am={U,k)e (i + Z) 2 |0<j,/c,j + A;<m}. 

Introduce the following numbers: 

Mm) 2 -Kiu-kKa-b) . n(j + k)(a + b) 
o;-,\, U \ = — e m sin . 



(j,k)(a,b) ~ m 

Provided that j, k G Z, one has: 

(m)± / I - 



77? 



(6.3) 



j,fc 



r r 



—ire 



Am) 



n(m) + 






(a,6)€A^ 



E s. 



(m) 

(i,fe)(a,b)- L a, b 



F„ ( T } -(r,z). 



Provided that j, k G ^ + Z, one has: 

(6.4) ,W-I,£) = - iTe -^ ^ 

It follows that the linear span of functions {-P 1 }™ and -F1-™ | (j, fc) G A+ UA~ } is invariant 
with respect to the action of 5'L 2 (Z) given by 

ar + b z 



F(r,z)\/ ab s = (cr + d) 1 e ™^+vF 



ct + d ' cr + d 



We want now to specialize to z — 0. Let yr- ^ (t) = -Fl™ (r, 0) for all (j, fc) G A m 
and ^ )_ (^) = FJ^~(t,0) for all (j, A;) G A~ U A+ except for (j, 0) G A+ (when the 
series diverges). These functions have the following power series expansions: 



(m)±/ \ 



oo — oo 

E- E 

a,&=0 a,6= — 1 



(±l) a+b q m ( a +^)( b +- 



(m)- 



In order to get SX2(Z)-invariance, we must add functions <p , (r) (j G Z, < j < m 
given by 



(m)- 



V.,0 



1 + 



oo — oo 

E- E 

i a, b=o a,b=-l , 



(_l)a+^ m ( a +^-) & _ 
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Then we have: 






(a,6)6A+ 

(-^) = -ir £ %*)(a,^S MresP+ V) if (J, *) e ^ (resp+) - 



(a, 6)6.4 

Note also that 

<P$ + (r + 1) = e^^.Jlr) if (j, fc) e A~ m , 

<p$-(r + 1) = e^^ +{ ^-\r) if (j, fc) G A-(-*>+). 

Thus we have constructed a finite set of modular forms of weight 1 whose linear span is 

SL2 (Z)-invariant. 

We derive now, using (6.3) and (6.4) the transformation properties of characters and 
supercharacters of the N = 2 superalgebras (cf. [RY]). Introduce the following normalized 
N = 2 demoninators: 

^(0)±/ N = niz TT l 1 "? I 

^(i/2)±/ n = 1/8 tt u-g > 

v ' I y 11 (l±qn-l/2 e -2niz\(l±qn-l/2 e 2Tvizy 

n=l ^ '^ ' 

From the transformation formula for © and r\ one gets: 



(-;,;) =re-^^°)-(T,z), 
*d/2)- (-^) = -zre"^vl>( ) + (r^ 



z 



One knows that the normalized characters and supercharacters of the unitary discrete 
series of the two N = 2 superalgebras corresponding to e = or | of central charge 3c m , 
where c m = 1 — — , m = 2, 3, . . . , are given by the following formulas ( [D] , [M] , [RY] ) : 



*( £ )+(r,2) 
sch^W) = ^ 
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if j, k E e + Z; the range of (j, k) is A+ or A m depending on whether e = or ^. From the 
above transformation formulas we obtain the following theorem. 

Theorem 6.1. (cf. [RY]) (a) If (j, k) e A~, then 

, (m,l/2) ( 1 z\ zij-lc m V^ c( m ) u( m >V 2 )/ ^ 

ch j,k {-r'rj =€ ^ 2^ S (J)(a,b) c K,b 'V,*), 

a,beA^ 

seh (m ' 1/2) (-- -\ - e^ c ™ V <? (m) ch {m ' 0) (r z) 

a,bEA m 

cn i^fc' (r + 1, z) = e~^~~^ sch^' >(t, z), 
sch^' 1/2) (r + !,*) = e^"^ ch^ 1/2) (r, z). 
(b)If(j,k)eA+,then 

ch (^,0) f _l A _ ^l Cm V- 9 (m) h (m,l/2) r x 

a,beA^ 

, (m,0) /" 1 ^\ • ii^-c m V^ c ( m ) u( m >0)/ \ 

Sch i,fc \-pr) = ~ le T ^ 5 0-,fc)(a,6) Sch a,6 V,*), 



aigi 



j^^-^m 



sclr. )A ,' (r + 1, z) = e ™ sch },fc ( r 5 *)• 

Corollary 6.1. The linear span of all normalized characters and supercharacters of 
the minimal unitary discrete series with central charge 3c m is invariant under the action 
of 6X2(2) defined by 

a b\ , t s Kicz 2 far + b z 

f{T,z) = e c-+d Cm f 



c d J ' \ct + d ' ct + d 

Example 6.1. m = 2 (minimal possible). Then A^ = {(1,0)}, A^ = {(|)|)}> an< ^ 
clr- ^ = scfr- £ = 1. Furthermore, 

Wai/2^ = (^ ( /Ti/ 2 (-^) = * (1/2) ~fr *)), =0 = ^ A (^) 2 ' 

^lo(r) = (F[ 2 l^z) = *<°>+(t,z)) = iD(- ? ) 2 . 
\ / 2=0 

These three functions span a 3-dimensional 5X2(Z)-invariant space of modular forms of 

(2)-\- 

weight 1. (Note that F{ (t, z) has a pole at z = 0.) 
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Remark 6.1. Similar results may be obtained for the affine denominator in the general 
case. As in [K5], this may be used in order to prove the "strange formula" (1.2). 

§7. The case h y = 0. 

The simplest non-trivial case when /i v = is q = A(l, 1). It is more convenient to 
consider $j = gl(2, 2) instead, with simple roots «i, «2, «3, such that (ai|ai) = (0:3 1 0:3) = 0, 
(o^lo^) = 2, — (ai|a!2) = (q!3|q!2) = 1. We conjecture that the denominator identity still 
holds with an extra factor. Namely, letting x = e~ ai , y = e _a2 , z = e _ ° 3 , introduce the 
following functions (fixed under W x £za 2 ) : 



/„ = x~ n z- n (x 2n - 1 - z 2n - x ){x ~z)J2 (-l) J 9 (i+1 

J6Z+ 



Conjecture 7.1. e p R = I 1 + J^ f n I J^ t nQ2 (e p R) . 

n-l J n&L 



)(i+2n)/2 



If we divide both sides by R and let i,i/,z^lwe obtain Jacobi's formula (0.4), i.e., 

n 8)n = i6^(-ir+^' 3 . 



3\n 



So far we have entirely left out the series of simple Lie superalgebras g of type Q(m), 
which do not admit a non-degenerate even invariant bilinear form (but admit an odd 
one), hence it is natural to let /i v = 0. Its even part Qo is a simple Lie algebra of type 
A m and the go-module jji is the adjoint A m -module. Let A (resp A+) denote the set of 
roots (resp positive roots) of A m , let IT = {«i, . . . , a m } be the set of simple roots, let p 
be the half of the sum of roots from A + , let W be the Weyl group, and let (.|.) be the 
VF-invariant bilinear form normalized by (ctij]a!j) = 2. Let s = [ m 2 ^" 1 ] and consider the 
following (maximal orthogonal) set of s roots: 71 = a\ + . . . + a m , 72 = 0:2 + - • - + «m-i, • • •• 
The denominator identity for Q(m) is given by the following formula: 

(7.1) R:= J] \^= J2e(w)wf[(l + e-^)-\ 

a£A + wEW j—1 
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The associated to Q(m) affine superalgebra g is a central extension (by CC) of the Lie 
superalgebra © j€Z t J 0j m od2 (its Cartan matrix is not symmetrizable) . We let q = —e~ c 
and define the affine denominator as follows: 



r = rtt( ( ? J TT o i 

n=l \ v ^ 7 a£A ^ 

In order to state the affine denominator identity, define t a for a G ZA as follows 

t a (e^) = q^^, (3 e ZA, t a (g) = g. 

Conjecture 7.2. e^R = ^ J] J] e( W )gl\i rei7l+ ... +risTs (e"^."' 7. 

In particular, for m — 1 Conjecture 7.2 reads 

(1 - q 2n ) 2 (l - q 2n - 2 x)(l - q^x- 1 ) 



n 



. (1 _ g 2n-l)2( 1 _ ^n-l^! _ g 

= J2 q 2jk+j+k (x~ j -x j+1 ) 



2n-l x -l- 



q 



1^ l_g2n+l x ' 

where x = e~ ai . This identity follows from (4.8) by replacing q by g 2 , y by — gx and x by 
— q. As we mentioned in Section 5, dividing both sides by 1 — x and tending x to 1, we 
recover Legendre's formula A(g) 4 . 

For m — 2, Conjecture 7.2 reads (here x = e _ai , y = e~ a2 ): 

(1 - g 2n ) 2 (l - q 2n - 2 x)(l - q 2n - 2 y)(l - q 2n ~ 2 xy) 



nv 



. (1 - ^-1)2(2 _ ^n-l^ _ g 2n-l y )(! _ gZn-l^) 

(1 - g 2n x _1 )(l - g 2n y _1 )(l - q^x^y- 1 ) 
X (1 - ^""^-^(l - ^"^-^(l - g 2 "-^" 1 ?/- 1 ) 

= E E ^-'(^^'(i-^Ki-yKi-^V)- 

j6N fceNodd 

Letting in this identity x = j/ = z, we obtain after dividing by (1 — z) 2 (l — z 2 ) 
(1 - g 2n ) 2 (l - q 2n z) 2 (l - g 2n z" 1 ) 2 (l - q 2n z 2 )(l - q 2n z~ 2 ) 



n.Ti 



L (1 _ g 2 --l) 2 (l - g 2n-l z )2(! _ g 2n-l z -l)2(! _ g 2n-l z 2)(! _ g 2«-l z -2) 



E E ^-^ 2 - 2j 



z j - 1 \ 2 ^' - 1 



,2-1/ Z 2 - 1 
j£N fceNodd 
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Letting z tend to 1, we obtain another Legendre's formula: 

a(«) 8 = E E A*-\ «■«., a 8 ,„= e (^T 

iPN jfcPNodd feln+l ^ ' 



j6N fceNodd fe|"+i 

fcodd 

Finally, dividing both sides of the identity for general m by R and evaluating at 
using Weyl's character formula we obtain the following two beautiful results for m = 2s — 1 
(resp. 2s): 

(7.2) A 4s2jn (respA 4s(s+1)>n ) = J^ ^ dimL (fci7i H + k s <y s ,A m ), 

where F^ n = < k G Z s + \ki > k 2 > . . . > k s , Y^i=i(^i(^ r i + 1) + ("i + 2 — 2z)r,) = n >, and 
L(A, A m ) denote the irreducible (finite-dimensional) module over A m with highest weight 

A. 

The simplest new formula corresponds to m = 3: 
Ai 6 , n = ^ Yl (2k 1 + 3)(2k 2 + l)(k 1 -k 2 + l) 2 (k 1 + k 2 + 2) 2 . 

ri,r2eZ_|_ 

fcj >fc 2 ez_|_ 

fe 1 (2r 1 +l) + fc 2 (2T- 1 +l)+3r 1 +r 2 =n 

Letting a = 2k± + 3, 6 = 2/^2 + 1, r = 2ri + 1, s — 2r 2 + 1, we get the following beautiful 
form of this formula: 

Ai 6 ,n = 7^3 J2 ab(a 2 -b 2 ) 2 . 

a,b,r, s^Nodd 

a>b 
ar J r bs = 2n-\-4 

Next new formula corresponds to m = 4: 

A 24 ,n = ^ £ ^(a 2 -b 2 )\ 

r,sGNodd 

a>fa 

ar-|-bs^n + 3 

In a similar way the general formula (7.2) can be rewritten as follows: 

4 — s(s — 1) _^ „ 

A 4* 2 ,n = n2s -l -, Yl ai ° s II ( a * ~ a j) 

1 lj' = l J* a 1 ,. . . ,a s GNodd ^<J 

7*1 , . . . , r s GNodd 
a]_ > . . . >a s 

A 4s(s +i),n = 2s - Yl (ai...a a ) 3 JJ(a?-aJ) . 

llj = l J ' ai,...,a s GN £<j 

r-\_ , . . . ,r s GNodd 
oj>... >a. s 

oiT"iH \-a s r s = n-\--^s(s-\-l) 
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§8. Integrable highest weight modules over g. 

Given a choice of A + C A, we associate to each A G F)* an irreducible highest weight 
module L(A) over g defined by the property that there exists a non-zero vector v\ such 
that: 

h(v\) = A(h)vA for h et), xi + (va) = 0, (t n ® g)i> A = for n > 0. 

The number c = A(C) is called the level of L(A). Note that L(A) := U(g)v\ is an 
irreducible highest weight module over g. 

Definition 8.1. A g-module L(A) is called integrable if the following two properties 
hold: 

(i) dimL(A) < oo, 

(ii) t n (g) g a are locally nilpotent for all a G Aq and n G Z. 

It is clear that if L(A) is an integrable highest weight g-module for some choice of 
A_|_, then it is an integrable highest weight module for any other choice of A_|_; also, L(A) 
is g-locally finite. The g-module L(A) is integrable if and only if chL(A) is invariant with 
respect to W x t M t . 

In order to classify integrable highest weight g-modules L(A), choose A + such that IT 
has a unique odd root (cf. Example 3.3). Note that «o is even if and only if $ is of the 
second type; in this case define 6 G A + C A + as in Example 3.1c. If g is of the first kind, 
i.e., of type A(m,n) or C(n), we define 6 = «o + 9', where the coefficients of 9' in terms 
of IT are the following: 

A(m,n), m>n Q- Q.. . -Q - ^- Q t - .. .- Q t 

C(m), m>2 (g) 1 - O - O 0^0- 

As before, we let k = (A|6* v ) and ki = (A|«V) for all non-isotropic ctij. 

Theorem 8.1. (a) For g of the second kind, the Q-module L(A) is integrable if and 
only if dim L(A) < oo (the corresponding conditions on k and the ki, i ^ 0, are given in 
[K2, p. 84]) andko G Z+. 

(b) For g of type A(m, n), m > n, the g-module L(A) is integrable if and only if 

(i) k G Z + and ki G Z + for i ^ and i ^ m + 1; 
(ii) when k < n, there exist r, s G Z + such that: r + s = k, (A|a ) — r + k m+n+ i + 

km+n + • • • + ^m+n-r+2, (A|Q! m +l) = S + /c m +2 + k m +3 + • • • + k m + s +l- 
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The (7(m)-module L(A) is integrable if and only if 
(i) k G Z+ and hi G Z_|_ for i ^ 0,1, 
(ii) if k = 0, then (A|a ) = (A|oi) = 0. 

Proof. We use two facts: (i) if a is a simple even root, then the root vector attached to 
—a is locally nilpotent on L(A) if and only if (A|o v ) G Z + ; (ii) any root from A can be 
made simple by applying a sequence of odd simple reflections. ■ 

One has the following expressions for the amne central charge c: 

A{m, n), m > n : c = k± + ■ ■ ■ + k m + k. 

C{m) : c = k 2 -\ h k m + k. 

B(m, n), D(m, n) : c = ko + k\ + . . . + k n -\ + k. 

D(2,l;a), F(4), G(3) : c = k + k. 

It follows that the amne central charge c of an integrable 0-module L(A) is a non-negative 
integer and that c = if and only if the q- module L(A) is 1-dimensional (which happens 
if and only if A|f,+cc = 0). 

Example 8.1. § = A(1,0). We choose IT = {0:1,0:2} where both oi and «2 are odd. 
Then (oi|oi) = (02I02) = 0, (01)02) = 1. Then «o = C — 01 — «2 is an even root. 
Let rrii = (A|«j), % — 0, 1,2. One has dimL(A) < 00 if and only if ra\ + ra^ 6 Nor 
777,1 = v ^2 = 0, and L(A) is integrable if, in addition, mo G Z+. The central charge 
c = mo + 777 1 + m2 (G Z + ). Assume that the following "non-degeneracy" condition holds: 

777^ 7^ (z = 1 or 2) =>- mi is not divisible by c + 1. 

Then the same argument as in Section 2 gives the following character formula: 

(8.1) e^RchL(A) = J^ t Q (e /5 RchL(A)). 

a€Ml 

In particular, if mi = 1112 = 0, we obtain for c G Z + : 



(8.2) e'R ch L(cd ) = Yl *<* (e'+^R) . 

Letting x = e~ ai , y = e~ a2 we may rewrite (8.2) as follows: 

(8.3) e- cd Rch L(cd) = J2 (-l) j+k x j y k q-& - ^ (-l) j+k x- j y- k q^ 

min(j,fe)e(c+l)Z min( j,k)€(c+l)N 
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Definition 8.2. An integrable g-module L(A) is called tame if its character is given by 
formula (8.1). 

Theorem 4.1 says that the 1-dimensional g-module is tame. 
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